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Abstract 

Biochemical signaling pathways can be insulated from impedance and 
competition effects through enzymatic "futile cycles" which consume energy, 
typically in the form of ATP. We hypothesize that better insulation neces- 
sarily requires higher energy consumption, and provide evidence, through 
the computational analysis of a simplified physical model, to support this 
hypothesis. 

1 Introduction 

An important theme in the current molecular biology literature is the attempt to 
understand cell behavior in terms of cascades and feedback interconnections of 
more elementary "modules," which may be re-used in different pathways [ll[2]. 
Modular thinking plays a fundamental role in the prediction of the behavior of a 
system from the behavior of its components, guaranteeing that the properties of 
individual components do not change upon interconnection. Intracellular signal 
transduction networks are often thought of as modular interconnections, passing 
along information while also amplifying or performing other signal-processing 
tasks. It is assumed that their operation does not depend upon the presence or 
absence of downstream targets to which they convey information. However, just 
as electrical, hydraulic, and other physical systems often do not display true mod- 
ularity, one may expect that biochemical systems, and specifically, intracellular 
protein signaling pathways and genetic networks, do not always "connect" in an 
ideal modular fashion. 

*Work done at: Department of Physics, Rutgers University, Piscataway, NJ 08854 USA 



Motivated by this observation, the paper [3] dealt with a systematic study of 
the effect of interconnections on the input / output dynamic characteristics of sig- 
nahng cascades. Fohowing [3], the term retroactivity was introduced in order 
to generically refer to such effects, which constitute an analog of non-zero out- 
put impedance in electrical and mechanical systems, and retroactivity in several 
simple models was quantified. It was shown how downstream targets of a signal- 
ing system ("loads") can produce changes in signaling, thus "propagating back- 
wards" (and "sideways") information about targets. Further theoretical work 
along these lines was reported in [5l|6j. Experimental verifications were reported 
in [7] and in [8j, using a covalent modification cycle based on a reconstituted 
uridylyltransferase/uridylyl-removing enzyme PII cycle, which is a model system 
derived from the nitrogen assimilation control network of Escherichia coli. 

The key reason for retroactivity is that signal transmission in biological systems 
involves chemical reactions between signaling molecules. These reactions take a 
finite time to occur, and during the process, while reactants are bound together, 
they generally cannot take part in the other dynamical processes that they would 
typically be involved in when unbound. One consequence of this "sequestering" 
effect is that infiuences are also indirectly transmitted "laterally," in that for a 
single input - multiple output system, the output to a given downstream system 
is influenced by other outputs. 

In order to attenuate the effect of retroactivity, the paper [3j proposed a negative 
feedback mechanism inspired by the design of operational amplifiers ( "OpAmps" ) 
in electronics, employing a mechanism implemented through a covalent modifica- 
tion cycle based on phosphorylation/dephosphorylation reactions. For appropri- 
ate parameter ranges, this mechanism enjoys a remarkable insulation property, 
having an an inherent capacity to shield upstream components from the infiu- 
ence of downstream systems and hence to increase the modularity of the system 
in which it is placed. One may speculate whether this is indeed one reason that 
such mechanisms are so ubiquitous in cell signaling pathways. Leaving aside spec- 
ulation, however, one major potential disadvantage of insulating systems based 
on "OpAmp" ideas is that they impose a metabolic load, ultimately because 
amplification requires energy expenditure. 

Thus, a natural question to ask from a purely physical standpoint is: does better 
insulation require more energy consumption? This is the subject of the present 
work. We provide a qualified positive answer: for a specific (but generic) model 
of covalent cycles, natural notions of insulation and energy consumption, and a 
Pareto-like view of multi-objective optimization, we find, using a numerical pa- 
rameter sweep in our models, that better insulation indeed requires more energy. 

In addition to this positive answer in itself, two major contributions of this work 
are: 

(a) we introduce two innovative measures of retroactivity, and dually insulation, 
in terms of two competing goals: (1) the minimization of the difference 
between the output of the insulator and the "ideal" behavior, and (2) the 
attenuation of the competition effect, the change in output when a new 
downstream target is added; 
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(b) we introduce a new way to characterize optimality through balancing of 
these goals in a Pareto sense. 

These contributions should be of interest even in other studies of insulation that 
do not involve energy use. 

We remark that the recent paper by Lan et al. [9] dealt with the need for en- 
ergy dissipation when improving adaptation speed and accuracy, in the context 
of perfect adaptation. Although we also ask about energy costs, our technical 
quantification of energy use, and also the problem that we consider, are very 
different. Also somewhat related is the recent paper by Shoval et al. [10], which 
also considers Pareto optimality in a biological context of balancing competing 
phenotype objectives. Again, our work is different, since a very different type of 
problem is analyzed. 



2 Statement of the problem 

We are interested in biological pathways which transmit a single, time-dependent 
input signal to one or more downstream targets. A prototypical example is a 
transcription factor Z which regulates the production of one or more proteins by 
binding directly to their promoters, forming a protein-promoter complex. As- 
suming a single promoter target for simplicity, this system is represented by the 
set of reactions 

0'4)zA0, 
Z+p c, ^^'^^ 

where p stands for the promoter and C denotes the protein-promoter complex. 
An analogous set of chemical reactions can be used to describe a signaling system 
in which Z denotes the active form of a kinase, and p is a protein target, which 
can be reversibly phosphorylated to give a modified form C. For our analysis, the 
particular interpretation of Z, p, and C will not be important. One thinks of Z 
as describing an "upstream" system that regulates the "downstream" target C. 
Although mathematically the distinction between "upstream" and "downstream" 
is somewhat artificial, the roles of transcription factors as controllers of gene 
expression, or of enzymes on substrate conversions, and not the converse, are 
biologically natural and accepted. 



Mathematical model of the basic reaction 

We adopt the convention that the (generally time-dependent) concentration of 
each species is denoted by the respective italics symbol; for example, X = X{t) 
is the concentration of X at time t. We assume that the transcription factor 
Z is produced or otherwise activated at a time-dependent rate k{t), and decays 
at a rate proportional to a constant 5, and that the total concentration of the 
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promoter ptot is fixed. This leads to a set of ordinary differential equations 
(ODEs) describing the dynamics of the system, 



dZ 

— = k{t) - 5Z - konZ (ptot -C) + kos C, 

dc (^-^^ 

= kon (Ptot -C)Z - kos C. 

The generalization of these equations to the case of multiple output targets is 
straightforward. Protein synthesis and degradation take place on time scales 
that are orders of magnitude larger than the typical time scales of small molecules 
binding to proteins, or of transcription factors binding to DNA [1 Ij . Thus we will 
take the rates k{t) and 6 to be much smaller than other interaction rates such as 



koa and k^fi. In (2.1) Z represents the input, and C the output. 



The ideal system and the distortion measure 

Sequestration of the input Z by its target p affects the dynamics of the system as a 
whole, distorting the output to C as well as to other potential downstream targets. 



In an "ideal" version of (2.2), where sequestration effects could be ignored, the 



dynamics would instead be given by 

f = Ht) - sz, 

dc (^-^^ 

= Kn (Ptot -C)Z - fcoff C. 

The term —koa_Z (ptot — C) + ^ofr C that was removed from the first equation rep- 
resents a retroactivity term, in the language of [3j . This is the term that quantifies 
how the dynamics of the "upstream" species Z is affected by its "downstream" 



target C. In the "ideal" system (2.3), the transmission of the signal from input 
to output is undisturbed by retroactivity effects. We thus use the (relative) dif- 
ference between the output signal in a system with realistic dynamics and the 



ideal output, as given by the solution of (2.3), as a measure of the output signal 



distortion, and define the distortion V to be 

V = (ladcal(t) - CrealWI), (2.4) 

'-'"Cidcal 

where (•) denotes a long time average. Here we normalize by dividing by the 
standard deviation of the ideal signal, 



\/((Cideal(t) - (Cideal(t)»2). (2.5) 



Thus (2.4) measures the difference between the output in the real and ideal 
systems, in units of the typical size of the time-dependent fluctuations in the 
ideal output signal. 
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Fan-out: multiple targets 



Another consequence of sequestration effects is the interdependence of the output 
signals to different downstream targets connected in parallel. Each molecule of 
Z may only bind to a single promoter at a time, thus introducing a competition 
between the promoters to bind with the limited amount of Z in the system. 
This is a question of practical interest, as transcription factors typically control 
a large number of target genes. For example, the tumor suppressor protein p53 
has well over a hundred targets |12] . A similar issue appears in biochemistry, 
where promiscuous enzymes may affect even hundreds of substrates. For example, 
alcohol dehydrogenases (ADH) target about a hundred different substrates to 
break down toxic alcohols and to generate useful aldehyde, ketone, or alcohol 
groups during biosynthesis of various metabolites p^. 

We quantify the size of this competition effect by the change in an output signal to 
a given target in response to an infinitesimal change in the abundance of another 



parallel target. For definiteness, consider (2.1) with an additional promoter p'. 



which bonds to Z to form a complex C with the same on/off rates as p: 

Z+p''^^C', 



and the corresponding equation added to (2.2) 

dC 



dt 



kon (Ptot -C) Z - kos C. 



We then define the competition effect of the system (2.2) as 



C 




(2.6) 



Pto 



Again we normalize by the standard deviation of the output signal C{t), 

ac = V{{C{t)-{C{tW), (2.7) 



computed with p[^^ = 0, so that (2.6) measures the change in the output signal 



when an additional target is introduced relative to the size of the fluctuations of 
the output in the unperturbed system. 



Design of an insulator 

As shown in Fig. [T| typical performance of the simple direct coupling system 
defined by ( |2.2| ) is poor, assuming, as in [3], that we test the system with a 
simple sinusoidally varying production rate 

k{t) = k {1 + sin ujt), (2.8) 

whose frequency lo is similar in magnitude to k and 6. Oscillation of the output 
signal in response to the time-varying input is strongly damped relative to the 
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Figure 1: Retroactivity effects lead to signal distortion, and attenuation of output 
signals when additional targets are added. Comparison of retroactivity effects on a sig- 
naling system with a direct coupling (DC) architecture (left) and one with an insulator, 
represented by a phosphorylation/dcphosphorylation cycle (right). Top row, a cartoon 
schematic of the signaling system. In the DC system (2.1), the input binds directly to 
the target. With an insulator ( |2.9[ ), the input drives phosphorylation of an interme- 
diate signaling molecule, whose phosphorylated form binds to the target. Middle row, 
illustration of distortion. The "ideal" output signal (blue), see (2.3 1, with retroactivity 
effects neglected, is plotted against the output for each system with nonlinear dynamics 
{oivnni), given by (2.2 1 for the DC system and (2.10) for the insulator. Bottom row, 
illustration of competition effect. The output signal in a system with a single target 
(orarujc) is compared with the output signal when multiple targets are present [greeri). 
Note the greatly reduced amplitude of variation of the output in the DC system. Plots 
of the output signals in each system are shown in the steady state, over a single period of 
k{t). This plot was made using the parameters k{t) — 0.01 (1 -I- sin (0.005 1)), 5 — 0.01, 
"1 = /3i = 0.01, a2 = /32 = fci = ^2 = 10, fcon = kos = 10, ptot = 100, and Xtot = 800, 
yj-Qj = 800 for the insulator. Parameters specifying the interaction with the new promoter 



p' in the perturbed system are k'^^ 



k' 



10, and p[^^ = 60. 
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ideal. The output is also sensitive to other targets connected in parallel; as the 
total load increases the output signal is noticeably damped in both the transient 
and steady state. Here the flux of Z into and out of the system is too slow to 
drive large changes in the output C as the rate of production k{t) varies. 

As suggested in [3], the retroactivity effects in this system can be significantly 
ameliorated by using an intermediate signal processing system, specifically one 
based on a phosphorylation/dephosphorylation (PD) "futile cycle," between the 
input and output. Such systems appear often in signaling pathways that mediate 
gene expression responses to the environment |TT] . In this system, the input signal 
Z plays the role of a kinase, facilitating the phosphorylation of a protein X. The 
phosphorylated version of the protein X* then binds to the target p to transmit 
the signal. Dephosphorylation of X* is driven by a phosphatase Y. Assuming a 
two-step model of the phosphorylation/dephosphorylation reactions, the full set 
of reactions is 

0'4)zA0, 

z+x ^ Ci x*+z, 

"li k, (2-9) 
Y+X* C2 4 X+Y, 

^on 

X*+p C. 

The total protein concentrations Xtot and Ytot are fixed. The forward and re- 
verse rates of the phosphorylation/dephosphorylation reaction depend implic- 
itly on the concentrations of phosphate donors and acceptors, such as ATP 
and ADP. Metabolic processes ensure that these concentrations are held far 
away from equilibrium, biasing the reaction rates and driving the phosphoryla- 
tion/dephosphorylation cycle out of equilibrium. As routinely done in enzymatic 
biochemistry analysis, we have made the simplifying assumption of setting the 
small rates of the reverse processes X*+Z — )■ Ci and X+Y — t- C2 to zero. The 
ODEs governing the dynamics of the system are then 

r '7 

— = k{t) -SZ- (3iZ (Xtot -Ci-C2-C) + (/32 + ^1) Ci, 



dCi 

dt 
dC2 
dt 

dX* 

dt 
dC 

~dt " 



= /3iZ (Xtot -C1-C2-C)- {(32 + h) Ci, 

--aiX*{Ytot-C2)-{a2 + k2)C2, (2.10) 
= fci Ci - aiX* (Ytot - C2) + CX2C2 - konX* (ptot -C) + kos C, 
konX* (ptot -C) - kos C. 



As shown in Fig. [T| for suitable choices of parameters the output signal in the 
system including the PD cycle is able to match the ideal output much more 
closely than in the direct coupling system. The output signal is also much less 
sensitive to changes in other targets connected in parallel than in the system 
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where the input couples directly to the promoter. One can think of this system 
with the insulator as equivalent to the direct coupling system, but with effective 
"production" and "degradation" rates 



kes{t) = kiCi + a2C2 



<^eflf = "1 (^tot - C2) , 



(2.11) 



which may be much larger than the original k{t) and 5, thus allowing the system 
with the insulator to adapt much more rapidly to varying input. 

The fact that the PD cycle is driven out of equilibrium, therefore consuming 
energy, is critical for its signal processing effectiveness. Our focus will be on how 
the performance of the PD cycle as an insulator depends upon its rate of energy 
consumption. 

Our hypothesis is that better insulation requires more energy consumption. In 
order formulate a more precise question, we need to find a proxy for energy 
consumption in our simple model. 

Energy use and insulation 

The free energy consumed in the PD cycle can be expressed in terms of the change 
in the free energy of the system AG resulting from the phosphorylation and 
subsequent dephosphorylation of a single molecule of X. One can also measure 
the amount of ATP which is converted to ADP, which is proportional to the 
current through the phosphorylation reaction Ci — > X*+Z. In the steady state, 
since the phosphorylation and dephosphorylation reactions are assumed to be 
irreversible and the total concentration Xtot is fixed, the time averages of these 
two measures arc directly proportional. The average free energy consumed per 
unit time in the steady state is then proportional to the average current 



Different choices of the parameters appearing in the phosphorylation and de- 
phosphorylation reactions, such as ki, k^-, and Xtot, will lead to different rates of 
energy use and also different levels of performance in terms of the competition 
effect and distortion. We focus our attention on the concentrations Xtot and 
Itot as tunable parameters. While the reaction rates such as k\ and ^2 depend 
upon the details of the molecular structure and are harder to directly manipulate, 
concentrations of stable molecules like X and Y can be experimentally adjusted, 
and hence the behavior of the PD cycle as a function of Xtot and Ytot is of great 
practical interest. 

Comparing different parameters in the insulator: Pareto optimality 

In measuring the overall quality of our signaling system, the relative importance of 
faithful signal transmission, as measured by small distortion, and a small compe- 
tition effect, will vary. This means that quality is intrinsically a multi-objective 

optimization problem, with competing objectives. Rather than applying arbi- 
trary weights to each quantity, we will instead approach the problem of finding 



J = {kiCi). 



(2.12) 
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ideal parameters for the PD cycle from the point of view of Pareto optimality, a 
standard approach to optimization problems with multiple competing objectives 
which was originally introduced in economics |10| . In this view, one seeks to 
determine the set of parameters of the system for which any improvement in one 
of the objectives necessitates a sacrifice in one of the others. Here, the competing 
objectives are the minimization of T> and C. 

A Pareto optimal choice of the parameters is one for which there is no other 
choice of parameters which gives a smaller value of both T> andC. Pareto optimal 
choices, also called Pareto efficient points, give generically optimum points with 
respect to arbitrary positive linear combinations aP + pC, thus eliminating the 
need to make an artificial choice of weights. 



An informal analysis 



A full mathematical analysis of the system (2.10) of nonlinear ODE's is difficult 



In biologically plausible parameter ranges, however, certain simplifications allow 
one to develop intuition about its behavior. We discuss now this approximate 
analysis, in order to set the stage for, and to help interpret the results of, our 
numerical computations with the full nonlinear model. 

We make the following ansatz: the variables Z{t) and X*{t) evolve more slowly 
than Ci{t), C2{t), and C{t). Biochemically, this is justified because phosphoryla- 
tion and dephosphorylation reactions tend to occur on the time scale of seconds 
|14^ [15] , as do transcription factor promoter binding and unbinding events |llj , 
while protein production and decay takes place on the time scale of minutes [11] . 
In addition, we analyze the behavior of the system under the assumption that 
the total concentrations of enzyme and phosphatase, Xtot and Itoti are large. In 



terms of the constants appearing in (2.10), we assume: 



_ (32 + ki 

J^l — n > -^tot > 1, 



Pi 

02 + ^2 

ai 



> Ytot > 1, 



1 > {k{t), 5] < kon ~ kos- 



Thus, in the time scale of Z{t) and X*{t)^ we can make the quasi-steady state 
(Michaelis-Menten) assumption that C\{t), C2{t), and C{t) are at equilibrium. 
Setting the right-hand-sides of 



and ^ to zero, and substituting in the 



dC 



remaining two equations of (2.10), we obtain the following system: 



dZ 

lit 
dX* 

~dr 



k{t) - 5Z, 

ki Ci -k2C2. 



The lack of additional terms in the equation for Z[t) is a consequence of the 
assumption that Ki ^ Atot, which amounts to a low binding affinity of Z to 
its target X (relative to the concentration of the latter); this follows from a 
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"total" quasi-steady state approximation as in |16l I17j . Observe that such an 



approximation is not generally possible for the original system (2.1), and indeed 
this is the key reason for the retroactivity effect [3]. 

With the above assumptions, in the system with the insulator Z{t) evolves ap- 
proximately as in the ideal system (2.3). In this quasi-steady state approximation 
Ci « (l/Ki)(Xtot -C1-C2- C)Z ^ {l/Ki)X,,tZ and C2 ~ (l/i^2)(l^tot - 
C2)X* « {l/K2)YtotX\ and thus we have 



dX* 
~dt 



{ki/Ki)XtotZ - {k2/K2)YtotX* 



Finally, let us consider the effect of the following condition: 

{ki/Ki)Xtot-{k2/K2)Ytoty^l. 



(2.13) 



If this condition is satisfied, then 



K{Z — X*), with » 1, which means 



that X*{t) 
ideal system (|2.3| 



Z{t), and thus the equation for ^ in (2.10) reduces to that for the 



In summary, if (2.13) holds, we argue that the system with 



the insulator will reproduce the behavior of the ideal system, instead of the real 
system ( |2.2[ ). Moreover, the energy consumption rate in (2.12) is proportional to 
feiCi ~ {ki/Ki)XtotZ, and hence will be large if condition (2.13) holds, which 
intuitively leads us to expect high energy costs for insulation. 

These informal arguments (or more formal ones based on singular perturbation 



theory [3j) justify the sufficiency, but not the necessity, of condition (2.13). Our 
numerical results will show that this condition is indeed satisfied for a wide range 
of parameters that lead to good insulation. 



3 Results 

We have explored the performance of the insulating PD cycle over an extensive 
range of parameters to test our hypothesis that better insulation requires more 
energy consumption. In Fig. [2] we show a plot of C and V for systems with a range 
of Xtot and Itoti obtained by numerical integration of the differential equations 
(2l0l)(see also Fig. [3] for a 3d view). Pareto optimal choices of parameters on the 



tested parameter space are indicated by black points. 

Superior performance of the insulator is clearly associated with higher rates of 
energy consumption, as shown in the figure. Typically the rate of energy con- 
sumption increases as one approaches the set of Pareto optimal points, referred 
to as the Pareto front. Indeed, choices of parameters on or near the Pareto front 
have some of the highest rates of energy expenditure. Conversely, the parame- 
ter choices which have the poorest performance also consume the least energy. 
As shown above, this phenomenon can be understood by noting that the energy 



consumption rate (2.12) will be large when the conditions for optimal insulation 
(2.13) are met. 

Note that it is possible for two different choices of the parameters Xtot and Itot 
to yield the same measures of insulation C and T>, but with different rates of 
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Figure 2: Performance of the insulator measured by the competition effect C and dis- 



tortion V of the output in the system with an insulator ( 2.10 1, tested over a range of Xtot 
and Itot varied independently from 10 to 10000 in logarithmic steps. For simplicity C and 
T) are rescaled such that the smallest (best) values are equal to one. Points are colored 
according to the logarithm of the rate of the rate of energy consumption of the PD cycle, 
from blue (lowest) to red (highest). Pareto efhcient parameter points are marked by 
black dots. Rates of energy consumption increases as one approaches the Pareto front; 
obtaining small values of the competition effect is particularly costly. For comparison, 
C and I? for the direct coupling system is marked by a white dot. See Section [3] for de- 
tails. This plot was made using the parameters k{t) = 0.01 (1 + sin (0.005 1)), S ~ 0.01, 
«! = /3i = 0.01, Q!2 = /32 = ^1 = ^2 = 10, kon = ^off = 10, and ptot = 100. 



11 



energy consumption. This results in a "fold" in the sheet in Fig. [2| most clearly 
observed near D = 10 and C = 4. We see then that while better insulation 
generally requires larger amounts of energy consumption, it is not necessarily 
true that systems with high rates of energy consumption always make better 
insulators. See also the three-dimensional plot of C, P, and J shown in Fig.|3]for 
a clearer picture. 

In addition to the general trend of increasing energy consumption as competi- 
tion effect or distortion decrease, we find that a strong local energy "optimality" 
property is satisfied. We observe numerically that any small change in the pa- 
rameters Xtot and Ytot which leads to a decrease in both the competition effect 
and distortion, must be accompanied by an increase in the rate of energy con- 
sumption, excluding jumps from one side of the "fold" to the other. This local 
property complements the global observation that Pareto optimal points are as- 
sociated with the regions of parameter space with the highest rates of energy 
consumption. 

While we find Pareto optimal choices of the concentrations Xtot and Ytot span 
several orders of magnitude, the ratio of Xtot to Itot is close to unity for nearly 
all Pareto optima (see Fig. [4]). A small number Pareto optimal points are found 
with very different total concentrations of X and Y, but these points appear to 
be due to boundary effects from the sampling of a finite region of the parameter 



space. Indeed, we have argued that the insulator should perform best when (2.13) 
is satisfied. For the choice of parameters considered here, this gives Xtot/^tot = 



{k2K\) / {kiK2) = 1. Tests with randomized parameters confirm that (2.13) gives 
a good estimate of the relationship between Xtot and Itot for Pareto optimal 
points (see Fig. [s] for an example). 

We also observe that there is a lower bound on the concentration of Xtot and Itot 
for optimal insulation. Though we tested ranges of concentrations from 10 to 
10000, the first optimal points only appear when the concentrations are around 
500, several times larger than the concentration of the target p and much, much 
larger than the concentration of Z. Interestingly, the insulator consumes less 
energy for these first Pareto optimal parameter choices than at higher concentra- 
tions, and achieves the best measures of distortion with relatively low competition 
effect as well. This suggests that smaller concentrations may be generically fa- 
vored, particularly when energy constraints are important. 

We conclude that the specification of Pareto optimality places few constraints on 
the absolute concentrations Xtot and Ytot in the model, save for a finite lower 
bound, but the performance of the insulator depends strongly on the ratio of the 
two concentrations. This observation connects with the work of Gutenkunst et 
al. [TSJ, who noted "sloppy" parameter sensitivity for many variables in systems 
biology models, excepting some "stiff" combinations of variables which determine 
a model's behavior. 

For comparison, we indicate the values of T) and C of the simpler direct coupling 
architecture, with no insulator, by a white dot in Fig. [2} While many choices 
of parameters for the insulating PD cycle, including most Pareto optimal points, 
lead to improvements in the distortion relative to that of the direct coupling sys- 
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1^ 



Figure 3: Three-dimensional plot of competition effect C and distortion T), along with 
the rate of energy consumption J, in the system including an insulator (2.10). Note the 
"fold" in the plot; it is possible for two different values of the parameters to yield the 
same measures of insulation C and V, but with different rates of energy consumption. 



tern, the most dramatic improvement is in fact in the competition effect. Roughly 
85% of the parameter values tested for the insulator have a lower value of the 
competition effect than that found for the direct coupling system. This suggests 
that insulating PD cycles may be functionally favored over simple direct bind- 
ing interactions particularly when there is strong pressure for stable output to 
multiple downstream systems. 

Finally, we note that the analysis performed here has not factored in the poten- 
tial metabolic costs of production for X and Y. Such costs would depend on the 
structure of these components, as well as their rates of production and degrada- 
tion, which we have not addressed and which may be difficult to estimate in great 
generality. However, as the rate of energy consumption increases with increasing 
Xtot and Ytot (see Fig. |4]), we would expect to find similar qualitative results 
regarding rates of energy consumption even when factoring in production costs. 
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Figure 4: Pareto optimal points are typically those which strike a balance between the 
total concentrations of X and Y, as indicated in (2.13). Scatter plot of the Pareto optimal 



sets of parameters Xtot and Ytot corresponding to those in Figs. [2][3j The background 
line shows (fci/ifi)Xtot = (fc2/^2)i1;ot for comparison. Each point is colored according 
to the rate of energy consumption for that choice of parameters. Increases in either Xtot 
or Ytot result in increased energy expenditure. Due to the limited range of parameters 
which could be tested, some Pareto optima lie along the boundaries of the parameter 
space (see the "elbow" in the scatter points at the top of the plot). 




Figure 5: Scatter plot of the Pareto optimal sets of parameters Xtot and 
Ytot for an insulator using the randomly shifted parameters. The background 
line shows {ki/Ki)Xtot = (^2/ ^2)^101 for comparison. Parameters used are 
k{t) = 0.0137(1 + sin (0.005 1)), S = 0.0188, ai = 0.0107, A = 0.0102, aa = 5.31, 
/32 = 16.42, ki — k2 = 10, fcon — 5.19, fcotr = 12.49, and ptot = 100. Each point is colored 
according to the rate of energy consumption for that choice of parameters (arbitrary 
scale, different from that of Figs.[2]|4]). 
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4 Discussion 



A very common motif in cell signaling is that in which a substrate is ultimately 
converted into a product, in an "activation" reaction triggered or facilitated by 
an enzyme, and, conversely, the product is transformed back (or "deactivated") 
into the original substrate, helped on by the action of a second enzyme. This type 
of reaction, often called a futile, substrate, or enzymatic cycle, appears in many 
signaling pathways: GTPase cycles [19], bacterial two-component systems and 
phosphorelays [201 EI] actin treadmilling [22] , as well as glucose mobilization [23] , 
metabolic control j24|, cell division and apoptosis f25], and cell-cycle checkpoint 
control [26j. See [27] for many more references and discussion. 

In this work we explored the connection between the ability of energy con- 
suming enzymatic futile cycles to insulate biochemical signaling pathways from 
impedance and competition effects, and their rate of energy consumption. Our 
hypothesis was that better insulation requires more energy consumption. We 
tested this hypothesis through the computational analysis of a simplified physi- 
cal model of covalent cycles, using two innovative measures of insulation, referred 
to as competition effect and distortion, as well as a new way to characterize op- 
timal insulation through the balancing of these two measures in a Pareto sense. 
Our results indicate that indeed better insulation requires more energy. 

Testing a wide range of parameters, we identified Pareto optimal choices which 
represent the best possible ways to compromise two competing objectives: the 
minimization of distortion and of the competition effect. The Pareto optimal 
points share several interesting features. First, they consume large amounts of 
energy, consistent with our hypothesis that better insulation requires greater en- 
ergy consumption. Second, the total substrate and phosphatase concentrations 
Xtot and Itot typically satisfy (2.11) (in natural units, this implies Xtot ~ ^tot)- 
There is also a minimum concentration required to achieve a Pareto optimal solu- 
tion; arbitrarily low concentrations do not yield optimal solutions. Interestingly, 
insulators with Pareto optimal choices of parameters close to the minimum con- 
centration also expend the least amount of energy, compared to other parameter 
choices on the Pareto front, and have the least distortion while still achieving 
small competition effect. This suggests that these points near the minimum con- 
centration might be generically favored, particularly when energy constraints are 
important. 

Many reasons have been proposed for the existence of futile cycles in nature, such 
as signal amplification, increased sensitivity, and "analog to digital" conversion 
of help in decision-making. An alternative, or at least complementary, possible 
explanation [3j lies in the capabilities of such cycles to provide insulation, thus 
enabling a "plug and play" interconnection architecture that might facilitate evo- 
lution. Our results suggest that better insulation requires a higher energy cost, 
so that a delicate balance may exist between, on the one hand, the ease of adap- 
tation through creation of new behaviors by adding targets to existing pathways, 
and on the other hand, the metabolic costs necessarily incurred in not affecting 
the behavior of existing processes. 
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